The ICARE Component-Based Approach for Multimodal Input Interaction: Application to real-time military aircraft cockpits

The area of multimodal interaction has expanded rapidly and since the seminal “Put that there” demonstrator of R. Bolt that combines speech, gesture and eye tracking, significant achievements have been made in terms of both modalities and real multimodal systems. Nevertheless the design and development of multimodal systems still remains a difficult task. In this article, we present a graphical platform called ICARE (Interaction CARE Complementarity Assignment, Redundancy and Equivalence-) for designing and developing multimodal input interaction. As part of the INTUITION project, we will explain how we design and develop multimodal input interaction using our tool ICARE for military aircraft cockpit in a real-time simulator of a military fighter.